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Abstract 


Because conventional optimal linear regulator theory results in a con- 
troller which requires the capability of measuring and/or estimating the entire 
state vector, it is of interest to consider procedures for computing controls • 
which are restricted to be linear feedback functions of a lower dimensional 
output vector and which take into account the presence of measurement noise ^ 

and process uncertainty. To this effec: a stochastic linear model has been 
developed that accounts for process parameter and initial uncertainty, measure- 
ment noise, and a restricted number of measurable outputs. Optimization with 
respect to the corresponding output feedback gains was then performed for both 
finite and infinite time performance indices without gradient computation by 
using Zangwill's modificatic of a procedure originaDly proposed by Powell. 
Results using a seventh order process show the proposed procedures to be very 
effective. 
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1 . 


Tntroduction 


Because conventional optimal linear re^i^ilator theory results in a con- 
troller which requires the capability of measuring and feeding back the entire 
state vector, it is of interest to consider proceduies for computing controls 
which are restricted to be linear feedback functiors of a lower dimensional 
output vector. Such a procedure, however, has its limitations in that the 
feedback gains will be functions of the initial state vector. In addition, the 
presence of measurement noise and process uncertainty can lead to additional 
problems relating to both modelling and computation, 

To this effect a stochastic linear model has been developed that accounts 
for process parameter and initial uncertainty, measurement noise, and a 
restricted number of measurable outputs. Both finite and infinite time per- 
formance indices were considered. Optimization with respect to the output 
feedback gain was performed without gradient computation by using Zangwill's^ 

P 

modification of a procedure originally proposed by Powt-r* , This procedure is 
such that if the cost index were indeed quadratic in the gains, then the search 
would be along a set of conjugate directions . 

The Zangwill-Powell method is especially useful for inf^ni^ ' time perform- 
ance indices since many of the procedures proposed to date for finding output 
feedback gains for such indices cannot be guaranteed to converge to a solution. ’ 
Additional problems also arise if an intermediate gain perturbation result in 
an unstable system. This can be immediately corrected using the Zangwill- 
Powell procedure by setting the index itself to a very large number. 

The effectiveness of the Zangwill-Powell algorithm was evaluated using sixth 
order linearized longitudinal equations of motion for an aircraft. Results showed 
the algorithms to be capable of converging to a set of gains useful for gust 
alleviation . 
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Problem Statement 


The system being optimized is of the form: 


• 

Process: x = 

5 Ax + Bu + AAx + ABu + v(t) 

(la) 

Measurement : 

y " Cx 

+ n(t) 

(lb) 

Control: 

u = Ky 


(Ic) 

Initial State 

ff(Xo 



Covariance: 

-o’ ' '’0 


where 

X = 

(n X 1) state vector 



u = 

(Z X 1) control vector 



y = 

(ra X 1} output vector 



K = 

gain matrix containing both fixed 

elements 


(most likely zero) and variable elements to be 
determined 

v,n = white noise vectors with respective covariance 
matrices V, N. 

and AA,AB = uncertainty in A and B respectively. 


IVo procedures were considered in order to take into account the total 
process uncertainty AAx + ABu; namely: 
l) Defining 

w(t) = AAx(t) + ABu(t) (2) 

as an additional white noise vector with zero mean and assigned covariance 
matrix W suitably chosen to reflect the uncertainty. The procedures S 
developed by O'oshi^ are then applicable to solution. 


Letting 

AAx = 

I 

1 

(3a) 

and 

ABu = 

1 

i ^ 

(3b) 


REPRODUCIBn,ITy op flin 
original PAnw (g 



where the 1 columns of4A undAB respectively, are in turn 

set equal to 




w 

w 


where w is a white noise vector with covariance matrix W, and 

are constant matrices. The optimization procedure cited o^ McLane^ are then 

applicable to the solution. 

Given the above two formulations, the performance index to be minimized 


Is: 


J = 



* T D 

(y Q y + u ru) dt 

0 


ih) 


where ^ denotes the statistical expectation operator. 
Substituting eqs. lb and Ic into J gives 


J = 


1 

T 


rT 

[x^C^QCx + 2x C Qn 

•*0 


T 

+ n Qn 


ip m m m m fp 

+ x C K RKCx + 2x C K Rn 


n^ R K n] dt (5) 


This formulation of the index can be simplified by noting that 
^ (x^ Qn) = (x^ R n) = 0 

T 

Furthermore (n Q n) is a constant term independent of the control and 
therefore has no effect on the index. Then minimization of (5) is equivalent 
to the minimization of 

^ ^ £ i f (c’’^ QC + c'^ R K G) X dt + fin^ k'^ R K n) 


( 6 ) 


Elimination of the expectation operator is low possible by recognizing 


that J can be rewritten as: 

J e Trace (c'^ Q C + R K c) S + Trace (K^ R K N) (7) 

where S = ^ | ^ (x x'^) dt (8) 

Thus upon computation of the integral of the state covariance matrix C (x x ), 
the value of the index can be found from cq. 7. 

In particular if T is finite, the covariance 

P = Su x"^) (9) 

can be readily propogated, given a value for K, as follows: 

5 

• Formulation defined by eq. 2 

P = (A + B K C) P + P (A + B K C)'^ + B K N k'^ + (V + W) (lOa) 


P(0) = £ (x(0) x^(0)) 


(10b) 


• Formulation defined by eq. 3 

P = (A + B K C) P + P(A + B K e)*^ + M(P, K) + N(K) 
T T 

+ B K N K B + V. 

/ 

P(0) = f'(x(0) x^{0)) 

where M(P,K) = I P F W F J 
ij ij 1 J 

N(K) = I G (K N K W g/ 
ij ^ 


(11a) 

(lib) 

(11c) 

(lid) 
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(lie) 


and 


Fj = Fj . I 0, (K C),j 

Kj = row of K 

4* V\ 

P = i - j component of P 
^ J 


For the case in which T = <», the integral S of eq. 8 wi? 1 not in 
general converge if there is measurement noise (n) and/or process noise (v). 
Thus as in refs. 3, U, 5, In the limit S will be replaced by 


S = Lim 


1 

T 


r 


P(t) dt = P 

ss 


( 12 ) 


where P is the steady state solution to either eq. 10 or eq. 11. 

5 S 


3. Computational Procedures 

Since the performance index (eq. 1 ) is easily evaluated given a value for 

1 2 . 

the gain matrix K, the Zangwill-Powell ’ method which does not require gradient 
computation is very attractive for optimization. In particular, the IMSL sub- 

7 

routine ZXPOWL was used for implementation. Starting with initial values for 

elements of the gain matrix K, successive perturbations are made in each of 

the variable elements and the corresponding value of J computed. Using the 

computed indices, perturbation directions are chosen such that convergence 1. 

the minimum of a quadratic function requires a finite number of Iterations. 

One particular attractive feature of the algorithms is the ability to correct, 

when T = for a set of unstable gains which do not permit the determination 

of a steady state covariance matrix, P. This was done by computing the 

eigenvalues of (A + B K C) for each perturbed value of K and setting J 

50 

equal to a very large number (i.e., 10 ) whenever instability is noted. 


U.' Experimental Results 

l(.l System definition 

8 

A modified 6-dimensional version of the TIPS aircraft with a 
^Bt input (cr •* 15 fps) was used for evaluation in the presence of a zero 
reference command. The corresponding variable definitions were as follows: 



pitch rate 

pitch angle 

velocity 

angle of attack 

elevator deflection 

direct lift flap deflection 

gust induced attack angle 


Plant control; 

u 



( elevator command 
lift flap command 






The structural matrices corresponding to climb condition, i.e., h ^ 1 ^ 2 h ra, 
V = 106 m/s, which were used for evaluation purposes are (see eq. l): 



A 


1 . 



.000035 

. 000231 

-.1*86 

-1*.3778 

-.1991*8 

-.1*86 

0. 

0. 

0. 

0, 

0. 

9. 

-32.17 

-.OII43 

18.027 

0. 

-3.0933 

.0518 

0.000013 

-.000531 

-1.223 

-.1273 

-.2667 

-1.223 

0. 

0. 

0. 

-20. 

0. 

0. 

0. 

0. 

0. 

0. 

-1*0. 

0. 

0. 

0. 

0. 

0. 

0. 

-.2781* 


/ 


0 . 


0 . 


0 . 




/ 


c = 


V 


1. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

1. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

1. 

0. 

0. 

0. 

61*. 63 

.00318 

.176 

1*41*. 2 

212.1 

100.4 

■444.2 

61.82 

,00580 

.193 

407.8 

-116.2 

85.5 

407.8 

0. 

.000013 

.000531 

1.223 

.1273 

.2667 

1.223 
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Corresponding sensor noise deviations were: 


a “ .5 deg/sec 
Og = 0.2 deg 


O = 0.05 g 
"z 


Since the only plant disturbance was the excitation for the gust 
^ (V^^) “0 i a 1 - 6 ; to account 1 >r a 15 fps standard deviation 
(Vj ) was set equal to .0003. 

Values for and in eq. were chosen to be representative 

of the inverse maximum squared value of the weighted variables. In particular 
the following values were used: 


*^11 


2500. 

^22 

- 

50. 

^33 

= 

50. 


= 

1:. 


= 

h. 

“^66 

= 

2500. 

r, , 

- 

6. 

11 


^^22 


3. 


Also considered was the situation in which no penalty was placed on n , , n 

Zi. Zd 

and y (i.e., qj^j^ = q^^ ^ = O). 

For the stochastic problem defined by eq. 2, the covariance W 
of the plant disturbance was chosen to be 

Diag (.2, 0., .0007, .0005, 0., 0.) 

These elements were chosen by computing for each component of the state 


equation 



whcj'e was approximated to reflect the data in reference 8. 

For the problem defined by eq. 3, the were set equal to 

zero, and the F^^'s were selected such that the standard deviations in the 
corresponding components of A were (in matrix fonn): 



h.2 Results 

Using the preceding data, the six gains relating q,A0,Aa to 

6e and 6z were determined, 
c c 

Of interest were the following observations: 

• Convergence time for the infinite time problem was an 

order of magnitude less than the time required for optimiza- 
tion over a two second interval. This resulted from having 
to compute only the solution to a set of algebraic equations 
rather than a set of differential equations, 

• Assuming that every 6 gain perturbations called for by the 
Zangwill -Powell method corresponds to a gradient evaluation, 
it was noted that the number of gradient evaluations performed 
by a steepest descent algorithm was comparable to the number 
performed by the Zangwill-Powell method. 

• For a finite time index it is indeed possible to obtain gains 

that yield an unstable set of eigenvalues. This resulted when 
the finite time version of the formulation defined by eq. 2 
was used with no weighting on *^z2’ 


In order to test performance with respect to the behavior of the 
states and the control signals, the gains were used to regulate the longitudinal 
motion subject to the initial condition: 

p “ .02r/s,A9 = .15r, Aa = ,15r 

Figure 1 depicts responses for q, a, and n^^^ which resulted 
from applying those gains which resulted from the finite time version of the 
formulation defined by eq. 2 when Vf = 0 and with no weighting applied to 

"z2- 

5. Conclusions 

Optimal output feedback control gains Vfere determined using the Zangvill- 
Powell procedure which does not require gradient computation. Two stochastic 
formulations of the process equation were considered in order to take into 
account process uncertainty, process disturbances and sensor noise. Results 
using a seventh order system show that the Zangwill-Powell method is very 
effective for control gain computation. 

Continuing efforts are considering such topics as; 

• Constraints on the gain magnitudes. 

• Effects of reference commands. 

• Evaluation of the two procedures for modelling process 


uncertainties . 
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